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5 BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to an electronic journal as a record of transactions in 
banking facilities and, in particular, relates to an electronic journal preparation system 
10 and an electronic journal preparation method. 

Description of the Related Art 

Conventionally, it has been common practice in banking facilities to prepare 
journals and to store these journals on paper for managing personal history backgrounds. 

15 As disclosed in detail in Japanese Unexamined Patent Application, First Publication No. 
Hei 5-233925, an electronic management system (that is, management by electronic 
journal) of the personal history backgrounds is adopted in place of management on paper. 
It is shown in the above-described Japanese patent application that transaction data in a 
text format in addition to face image data corresponding to the transaction data for 

20 security purposes are recorded in an electronic journal medium. It is also disclosed in 
another patent application that an embosseded image of a personal card can be recorded 
instead of the face image data. After revision of the Commercial Law, management by 
electronic journals was authorized. 

As described above, recently, in banking facilities, electronic management (that is, 

25 management by electronic journal) has become popular in place of paper management. 
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However, since the transaction data is stored in the text format, a problem arises in that 
the personal history backgrounds can be easily altered. 



SUMMARY OF THE INVENTION 
5 An object of the present invention is to provide an electronic journal preparation 

system and an electronic journal preparation method, in which the personal history 
backgrounds are difficult to alter. 

The present invention provides an electronic journal preparation system 
comprising: a face image pick-up portion for picking up a face image of a customer by a 
10 fixed camera, a card embossed image pick-up portion for picking up a card embossed 
image from a bank card when said customer inputs said bank card; a customer 
transaction data image processing portion for forming an image regarding customer 
transaction data; a journal data synthesizing portion for synthesizing journal data by 
assembling said face image picked up by said face image pick-up portion, said card 
15 embossed image picked up by said card embossed image pick-up portion, and said 
customer transaction data image picked up by said customer transaction data image 
processing portion; and a journal data storing portion for storing said journal data 
synthesized by said journal data synthesizing portion into an electronic recording 
medium provided in the present journal preparation system. 
20 In the above electronic journal preparation system, said journal data synthesizing 

portion adds character data to a header portion of said journal data. 

In the above electronic journal preparation system, said journal data synthesizing 
portion inserts a watermark in said customer transaction data. 

The present invention provides an electronic journal preparation method 
25 comprising the steps of; picking up a face image of a customer by a fixed camera in the 
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electronic journal preparation system (step 1); picking up a card embossed image from a 
bank card when said customer inputs said bank card (step 2); forming an image of a 
customer transaction data (step 3); synthesizing said face image, said card embossed 
image, and said customer transaction data image into a journal data (step 4); and storing 
5 said j ournal data into an electronic recording medium provided in the electronic j ournal 
preparation system (step 5). 

In the above electronic journal preparation method, character data of said 
customer transaction data is added to the header portion of said journal data in said step 
4. 

10 In the above electronic journal preparation method, watermark data is inserted in 

said journal data in said step 4. 

The present invention also provides an automatic teller machine which uses the 
above-described electronic journal preparation system. 

The present invention also provides an unmanned contracting machine which uses 
15 the above-described electronic journal preparation system. 

The present invention also provides a counseling terminal which uses the 
above-described electronic journal preparation system. 



BRIEF DESCRIPTION OF THE DRAWINGS 
20 Fig. 1 is a block diagram showing one embodiment of the present invention. 

Fig. 2 is a diagram showing the external appearance of a bank terminal according 
to the present invention. 

Fig. 3 is a diagram showing the results of the composition of journal data. 
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DETAILED DESCRIPTION OF THE INVENTION 
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Hereinafter, embodiments of the present invention will be described with 
reference to the attached drawings. 

Fig. 1 is a block diagram showing one embodiment of the present invention. 
Fig. 2 is a diagram showing the external appearance of a bank terminal according to the 
5 present invention. Fig. 3 is a diagram showing an example of the results of the 
composition of journal data. 

Referring to Fig. 1 , the present invention is provided with a program display 
portion 1, a face image pick-up portion 2, a card embossed image pick-up portion 3, a 
service execution portion 4, a customer transaction data image processing portion 5, a 
10 journal data synthesizing portion 6, and a journal data storing portion 7. 

The program display portion 1 indicates programs to the customer which can be 
selected by the customer. The face image pick-up portion 2 has a function to pick up a 
face image of a customer by a fixed camera. The card embossed image pick-up portion 
picks up a card embossed image by an image sensor provided at a bank card transfer 
15 portion. The service execution portion 4 provides a service, which is selected by a 

customer from a program screen among services, such as payment, deposit, and transfer 
of money. The customer transaction data image processing portion 5 fills up the 
transaction data of a customer into a prescribed table for imaging the table after 
executing the service by the service execution portion 4. The journal data synthesizing 
20 portion 6 has a function to synthesize a face image obtained by the face image pick-up 
portion 2, a card embossed image obtained by the card embossed image pick-up portion 
3, and a customer transaction data image obtained by the customer transaction data 
image processing portion 5 into a predetermined form as a journal. The journal data 
storing portion 7 stores the journal data prepared by the journal data synthesizing portion 
25 6 into an HDD provided in the system, and the data is periodically output to an MO. 
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The processing for imaging the customer transaction data in the customer 
transaction data image processing portion 5 is a conventional technique; therefore, the 
imaging processing will not be described. 

The journal data synthesizing portion 6 synthesizes the face image, the card 
5 embossed image, and the customer transaction data image into one image 32, and adds 
the customer transaction data image as a character data to the header for an index. 

At this time, the journal data synthesizing portion 6 forms or inserts a watermark 
into one image data in order to achieve a marked improvement in preventing 
unauthorized alteration. 
10 Although the technique of inserting the watermark is conventionally known, it is 

briefly described as follows. 



< Insertion of the watermark> 
(1) Convert the image into frequency domains . 
15 (2) Cognitive extraction of the important spectrum. 

(3) Insert (add) an electronic watermark (vectors of the random noise) to the 
above-described spectrum. 

(4) Register the relationship between the electronic watermark and bibliographical 
information. 

20 (5) Generate an image by reverse conversion of the spectrum. 



<Detection of the electronic watermark> 

(1) Convert the image to be detected and the original image into, spectra. 

(2) Calculate the difference, that is, the electronic watermark. 

25 (3) Compare the difference with the electronic watermark which is registered in the data 
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base. 

(4) Determine whether the watermark has been altered. 

Hereinafter, the functions of a bank terminal (automatic teller machine, ATM) 
5 such as payment, deposit, and transfer of money, are described with reference to Fig. 2. 
The reference symbols in Fig. 2 represent the following items, 
a: face image camera portion for obtaining a face image of an applicant, 
b: bankbook processing portion, which is used when the applicant prints a bankbook or 
when the bankbook is issued. 
10 c: card receipt portion, which processes the customer's card and which outputs a receipt 
after printing the transaction of the customer; the transfer portion includes an image 
sensor. 

d: paper bill processing portion, 
e: coin processing portion. 
15 f: customer information display screen, which displays information for customers to 
handle the automatic teller machine. 

g: handling item indicating portion, which displays items to be operated by the customer, 
h: two-part display screen, which represents either that the automatic teller machine is 
"continue" or "terminate". 
20 i: bank card (magnetic card). 

j : embossed portion on the bank card. 

The operations of the present invention will be described in detail with reference 
to Figs. 1,2, and 3. 

1 . The program display portion 1 displays programs on the customer information 
25 display screen f, and a customer selects for example, "payment". After selection, the 
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program display portion 1 displays an instruction "Please look at the location where the 
lamp is lit, (the customer looks at an LED lit on the machine.) 

2. The face image pick-up portion 2 picks up a face image using the face image camera 
portion a, and face image data is acquired by the automatic teller machine, which 

5 displays an instruction on the customer information display screen f "Please insert bank 
card into the card receipt portion". (The customer inserts the bank card i into the card 
receipt portion c in accordance with the instruction). 

3. The card embossed portion 3 picks up an image data of the embossed portion on one 
surface of the bank card i, and acquires the card embossed image. 

10 4. The service execution portion 4 executes a program selected by the customer. 

When the customer selects "payment", the service execution portion 4 executes payment 
of the money. 

5. The customer transaction data image processing portion 5 forms image data of the 
customer transaction (for example, how much money is payed to the customer at what 

15 time). 

6. The journal data synthesizing portion 6 synthesizes a face image acquired by the 
face image pick-up portion 2, a card embossed image acquired by the card embossed 
image pick-up portion 3, and the customer transaction data image acquired by the 
customer transaction data image processing portion 5 into a predetermined form as 

20 journal data. An example of the synthesized data corresponds to one image data 32. 
Furthermore, the journal data synthesizing portion 6 adds customer transaction data to 
the header portion for retrieval and adds information for the electronic watermark. 

7. Finally, the journal data storing portion 7 stores the journal data synthesized by the 
journal data synthesizing portion 6 as image data into an HDD provided in the system 

25 and periodically records it in an MO (electronic storing medium). 
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As described above, the present invention is characterized in that the customer 
transaction data is stored in the journal as image data, which is synthesized by the 
journal data synthesizing portion 6, so that the present invention is far more effective 
than the conventional technique, which stores data as numerical values, in preventing the 
transaction data from unauthorized alteration. 

The reason is that when the data is stored as numerical values, it is easy to alter the 
data by use of a key board even without using a particular tool. That is, it is possible to 
alter the data on the automatic teller machine. 

However, when the customer transaction data is converted into image data, it is 
impossible to alter the image data on the ATM because an image editor is required for 
altering the image data. If the MO (electronic recording medium) is drawn out of the 
system for altering the data, it is necessary to return the data to the ATM which requires 
a lot of time. 

In addition, since the present invention allows insertion of an electronic watermark 
into the image data, it is possible to determine whether the image data is original or has 
been altered, and the effect of protecting the data from alteration is further enhanced. 

Note that the present invention can be applied not only to automatic teller 
machines but also to various systems such as unmanned contracting machines, 
counseling terminals, and POS systems. 

As described above, the present invention has a remarkable effect in protecting 
personal history backgrounds from unauthorized alteration by storing journal data after 
synthesizing the face image, the card embossed image, and the customer transaction 
data image, and by inserting an electronic watermark into the image journal data. 



